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Abstract 

We show the existence of an FPTAS for the problem of maximizing a non- 
negative polynomial over mixed-integer sets in convex polytopes, when the 
number of variables is fixed. 

1 Introduction 

A well-known result by H.W. Lenstra Jr. states that linear mixed integer program- 
ming problems with fixed number of variables can be solved in polynomial time 
on the input size ^Uj- It is a natural question to ask what is the computational 
complexity, when the number of variables is fixed, of the non-linear mixed integer 
problem 

max f(x 1 ,...,x dl ,zx,...,z d3 ) (la) 
s.t. Ax + Bz<b (lb) 
Xi G R for i = 1, . . . , di, (lc) 

Zi G Z for i = 1, . . . , d%, (Id) 

where / is a polynomial function of maximum total degree D with rational coeffi- 
cients, and A G Z mxdl , B G Z mxd2 , b G Z m (here we assume that Ax + Bz < b 
describes a convex polytope, which we denote by P). 

It was well-known that continuous polynomial optimization over polytopes, with- 
out fixed dimension, is NP-hard and that an FPTAS is not possible. Indeed the max- 
cut problem can be modeled as minimizing a quadratic form over the cube [—1, l] d 
[2]. More strongly, it turns out that, even for dimension two and total degree of / 
four, problem Q is an NP-hard problem too 0. Thus the best we can hope for, 
even for fixed dimension, is an approximation result. This paper presents the best 
possible such result: 
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Theorem 1.1. Let the dimension d = d\ + da be fixed. 

(a) There exists a fully polynomial time approximation scheme (FPTAS) for the opti- 
mization problem (^Q) for all polynomial functions f € Q[sci, . . . , x dl , Z\, . . . , z d2 ] 
that are non-negative on the feasible region (|lbHld|) . (We assume the encoding 
length of f is at least as large as its maximum total degree.) 

(b) Moreover, the restriction to non-negative polynomials is necessary, as there does 
not even exist a polynomial time approximation scheme (PTAS) for the maxi- 
mization of arbitrary polynomials over mixed-integer sets in polytopes, even for 
fixed dimension d > 2. 

The proof of lTheorem 1.11 is presented in lsection 41 As we will see. ITheorem 1 . Tl 
is a non-trivial consequence of the existence of FPTAS for the problem of maximiz- 
ing a non-negative polynomial with integer coefficients over the lattice points of a 
convex rational polytope. That such FPTAS indeed exists was recently settled in 
our paper [£]. The knowledge of paper is not necessary to understand this paper 
but, for convenience of the reader, we include a short summary in an appendix. 
Our arguments, however, are independent of which FPTAS is used in the integral 
case. Our results come to complement other approximation schemes investigated 
for continuous variables and fixed degree (see [3] and references therein). 

One interesting property of our FPTAS is that it does not depend on dynamic 
programming, unlike most known FPTAS (see comments and references in the in- 
troduction of Instead our main approach is to use grid refinement in order to 
approximate the mixed- integer optimal value via auxiliary pure integer problems. 
One of the difficulties on constructing approximations is the fact that not every 
sequence of grids whose widths converge to zero leads to a convergent sequence 
of optimal solutions of grid optimization problems. This difficulty is addressed in 
Isection 2l In lsection 31 we develop techniques for bounding differences of polynomial 
function values. Finally. Isection 4l contains the proof of lTheorem 1.11 



2 Grid approximation results 

An important step in the development of an FPTAS for the mixed-integer opti- 
mization problem is the reduction of the mixed-integer problem to an auxiliary 
optimization problem over a lattice ±Z dl x Z d2 . To this end, we consider the grid 
problem 

max f(xi,...,x dl ,zi,...,z d2 ) 

s.t. Ax + Bz < b 

i ~ ( 2 ) 
Xi G for % = 1, .. . ,di, 

z% € Z for £ = 1, ... , c?2 - 

We can solve this problem approximately using the integer FPTAS (|Theorem A.3|) : 

Corollary 2.1. For fixed dimension d = d% + di there exists an algorithm with 
running time polynomial in logm, in the encoding length of f and of P, in the 
maximum total degree D of f, and in - for computing a feasible solution (x™,z™) € 
P n (^Z ' 1 x Z^ 2 ) to the grid problem (J2J), where f is non-negative on the feasible 
region, with 

/( X r,zD>(l-6)/(x m ,z m ), (3) 
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^Z dl x Z d2 ) is an optimal solution to ©. 
Proof. We apply ITheorem A.3l to the pure integer optimization problem: 
max /(x, z) 

s.t. Ax + mBz < mh , v 

(4) 

Xi G Z for i = 1, . . . , di, 

Zi G Z for i = 1, . . . , 

where /(x, z) := mP /(— x, z) is a polynomial function with integer coefficients. 
Clearly the binary encoding length of the coefficients of / increases by at most 
\D\ogm\, compared to the coefficients of /. Likewise, the encoding length of the 
coefficients of mB and mh increases by at most [logm] . By Theorem 1.1 of jS], there 
exists an algorithm with running time polynomial in the encoding length of / and 
of Ax + mBz, < mh, the maximum total degree D, and - for computing a feasible 
solution (xf,zf) G Pn (±Z dl x Z d2 ) such that /(xf,z™) > (1 - e)/(x m ,z m ), 
which implies (0. □ 

One might be tempted to think that for large-enough choice of m, we immediately 
obtain an approximation to the mixed-integer optimum with arbitrary precision. 
However, this is not true, as the following example demonstrates. 

Example 2.2. Consider the mixed-integer optimization problem 

max 2z — x 
s.t. z < 2x 

z<2(l-x) ^ 
x G R+, z G {0, 1}, 

whose feasible region consists of the point (^, 1) and the segment { (x, 0) : x G [0, 1]}. 
The unique optimal solution to © = 1. Now consider the sequence of 

grid approximations of © where x G ^Z + . For even m, the unique optimal solution 
to the grid approximation is x = ry, z = 1. However, for odd m, the unique optimal 
solution is x = 0, z = 0. Thus the full sequence of the optimal solutions to the grid 
approximations does not converge since it has two limit points. 

However we can prove that it is possible to construct, in polynomial time, a sub- 
sequence of finer and finer grids that contain a lattice point (x, z*) that is arbitrarily 
close to the mixed- integer optimum (x*,z*). This is the central statement of this 
section and a basic building block of the approximation result. 

Theorem 2.3 (Grid Approximation). Let d\ be fixed. Let P = { (x, z) G 
R di+d 2 ■ Ax + Bz,<h], where A G Z mxdl , B G Z mxd2 . Let M e~R.be given such 
that P C { (x, z) G JH dl+d ' 2 : \xi\ < M for i = 1, . . . , d\ }. There exists a polynomial- 
time algorithm to compute a number A such that for every (x*,z*) G Pn(R dl x Z d2 ) 
and 5 > the following property holds: 

Every lattice ^Z dl x Z d ' 2 for m = A;A and k > |(di + 1)M contains a 
lattice point (x,z*) G P D (^Z dl x Z da ) with ||x-x*j| < 5. 
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ITheorem 2.31 follows directly from the next two lemmas. 



Lemma 2.4 (Integral Scaling Lemma). Let P = {(x,z) G R d i+ d 2 . Ax + Bz < 
b}, where A G 2 mxrfl , I? £ z mxrf2 . For fixed d\, there exists a polynomial time 
algorithm to compute a number A G Z>o smc/i i/iai /or every z G Z^ 2 £/ie polyhedron 

AP Z = { Ax : (x, z) G P } 

is integral. In particular, the number A /ias an encoding length that is bounded by a 
polynomial in the encoding length of P. 

Proof. Because the dimension d\ is fixed, there exist only polynomially many sim- 
plex bases of the system Ax < b — Bz, and they can be enumerated in polynomial 
time. The determinant of each simplex basis can be computed in polynomial time. 
Then A can be chosen as the least common multiple of all these determinants. □ 

Lemma 2.5. Let Q C R d be an integral polytope, i.e., all vertices have integer 
coordinates. Let M G R be such that Q C {x G R d : \xi\ < M for i = 1, . . . ,d}. 
Let x* G Q and let 5 > 0. Then every lattice for k > ^(d+ 1)M contains a 
lattice point x G Q n ^Z d with ||x — x*||oo < 5. 

Proof. By Caratheodory's Theorem, there exist d + 1 vertices x°, . . . , x d G Z d of Q 
and convex multipliers Ao, • • • , such that x* = J2i=o ^i x *- Let A^ := \ \k\i\ > 
for i = 1, . . . , d and A' := 1 - £? =1 A^ > 0. Then x := J2i=o A i x * G Q n i 2 ^' and 
we have 

d 

||x - xloo < ~ Ai)l|xi|oo < (d + 1)-M < 5. 

□ 



3 Bounding techniques for polynomial functions 

Using the results of Isection 2l we are now able to approximate the mixed-integer 
optimal point by a point of a suitably fine lattice. The question arises how we can 
use the geometric distance of these two points to estimate the difference in objective 
function values. We prove ITheorem 3.11 that provides us with a local Lipschitz 
constant for the polynomial to be maximized. 

Lemma 3.1 (Local Lipschitz constant). Let f be a polynomial in d variables 
with maximum total degree D. Let C denote the largest absolute value of a coefficient 
of f. Then there exists a Lipschitz constant L such that |/(x) — /(y)| < L||x — y||oo 
for all \xi\, \yi\ < M. The constant L is 0(D d+1 CM D ). 

Proof. Using the usual multi-index notation, let /(x) = Y2aeT> c a xQ! - 

Let r = \V\ 

be the number of monomials of /. Then we have 

|/(x)-/(y)|<^|c a |K- y «|. 
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We estimate all summands separately. Let a ^ be an exponent vector with 
n := Ya=i a i — D. Let 

a = a > a 1 > ■ ■ ■ > a n = 

be a decreasing chain of exponent vectors with a'" 1 — a 1 = for i = 1, . . . , n. Let 
(3 l := a — a 1 for i = 0, . . . , n. Then x a — y a can be expressed as the "telescope 
sum" 

x " - y" = x a V° - X^y^ + X^V 1 - X<*V 2 + X-V" 

n 

i=l 
i=l 

Since jx^'y^ | < M n_1 and n < D, we obtain 

|x a -y"| ^D-Hx-ylloo-M"- 1 , 

thus 

\f(x)-f(y)\<CrDM D - 1 \\y.-y\\ 00 . 

Let L := CrDM - 1 . Since r = 0(D d ), we have L = 0(D d+l CM D ). □ 

Moreover, in order to obtain an FPTAS, we need to put differences of function 
values in relation to the maximum function value. To do this, we need to deal 
with the special case of polynomials that are constant on the feasible region; here 
trivially every feasible solution is optimal. For non-constant polynomials, we can 
prove a lower bound on the maximum function value. The technique is to bound the 
difference of the minimum and the maximum function value on the mixed-integer 
set from below; if the polynomial is non-constant, this implies, for a non-negative 
polynomial, a lower bound on the maximum function value. We will need a simple 
fact about the roots of multivariate polynomials. 

Lemma 3.2. Let f G Q[#i, • • • ,Xd] be a polynomial and let D be the largest power 
of any variable that appears in f. Then f = if and only if f vanishes on the set 
{0,...,D} d . 

Proof. This is a simple consequence of the Fundamental Theorem of Algebra. See, 
for instance, ,3, Chapter 1, §1, Exercise 6b]. □ 

Lemma 3.3. Let f 6 Q[ x\, . . . ,Xd] be a polynomial with maximum total degree D. 
Let Q C R d be an integral polytope of dimension d' < d. Let k > D d! . Then f is 
constant on Q if and only if f is constant on Q n ^Z d . 

Proof. Let x° € QnZ d be an arbitrary vertex of Q. There exist vertices x 1 , . . . , x d ' € 
QnZ rf such that the vectors x 1 — x°, . . . , x d — x° E Z d are linearly independent. 
By convexity, Q contains the parallelepiped 

S ■= { x° + Eti Mx* - x°) : ^ e [0, for i = 1, . . . , d' } . 
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We consider the set 

S k = lZ d n S 5 { x° + Eti t^(x* -x°) : m e {0, 1, . . . ,£>} for » = 1, . . . ,d' } . 

Now if there exists a c € R with /(x) = c for x G Q n ^Z^, then all the points in 
Sf. are roots of the polynomial / — c, which has only maximum total degree D. By 
ITheorem 3.21 (after an affine transformation), / — c is zero on the affine hull of 
hence / is constant on Q. □ 

Theorem 3.4. Let f G Z[xi, . . . , ,Zi,..., za 2 ]- Let P be a rational convex poly- 
tope, and let A be the number from Theorem 2.J\ Let m = kA with k > Dd\, 



k G Z. Then f is constant on the feasible region P n (R dl x Z^ 2 ) if and only if f is 
constant on P n (^Z dl x Z d2 ) . If f is not constant, then 

| /( x max) z max) / ( x min j z min ) | ^ Tfl , (6) 

where (x max , z max ) is an optimal solution to the maximization problem over the feasi- 
ble region Pd (R dl x Z^ 2 ) and (x min , z min ) is an optimal solution to the minimization 
problem. 

Proof. Let / be constant on P n (^Z dl x Z d2 ). For fixed integer part z € Z d2 , we 
consider the polytope AP Z = { Ax : (x, z) G P\, which is a slice of P scaled to 
become an integral polytope. By applying ITheorem 3.3l with k = (D + l)d on every 
polytope AP Z , we obtain that / is constant on every slice P z . Because / is also 
constant on the set P n (^;Z dl x Z^ 2 ), which contains a point of every non-empty 
slice P z , it follows that / is constant on P. 

If / is not constant, there exist (x 1 ^ 1 ), (x 2 ,z 2 ) G P D (^Z dl x Z^ 2 ) with 
/(x^z 1 ) ^ /(x 2 ,z 2 ). By the integrality of all coefficients of /, we obtain the 
estimate 

|/(x 1 ,z 1 )-/(x 2 ,z 2 )|>m- D . 

Because (x^z 1 ), (x 2 ,z 2 ) are both feasible solutions to the maximization problem 
and the minimization problem, this implies ©• □ 



4 Proof of Theorem 1.1 



Now we are in the position to prove the main result. 

Proof of \Theorem l.ll Part (a). Let (x*,z*) denote an optimal solution to the 
mixed-integer problem l[T|). Let e > 0. We show that, in time polynomial in the 
input length, the maximum total degree, and -, we can compute a point (x, z) that 
satisfies (jlbHld|) such that 

|/(x,z)-/(x*,z*)|<e/(x*,z*). (7) 

First we note that we can restrict ourselves to the case of polynomials with 
integer coefficients, simply by multiplying / with the least common multiple of all 
denominators of the coefficients. We next establish a lower bound on /(x*,z*). 
To this end, let A be the integer from ITheorem 2.4| which can be computed in 
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polynomial time. By ITheorem 3.41 with m = DdiA, either / is constant on the 
feasible region, or 

/(x'.z^pdiA)- , (8) 
where D is the maximum total degree of /. Now let 

5 := 2(Dd 1 A) D L(C,D,M) (9) 



and let 

m : A -(Dd 1 A) D L(C,D,M)(d 1 + 1)M 



(10) 



where L(C, D, M) is the Lipschitz constant from ITheorem 3TT1 Then we have m > 
A±(c2i + 1)M, so bv lTheoremlHl there is a point ([x*] s ,z*) € Pn {^Z dl X Z da ) 
with ||Lx*],5 — x*|| < 5. Let (x m ,z m ) denote an optimal solution to the grid 
problem ((2j). Because (Lx*]<5,z*) is a feasible solution to the grid problem (0), we 
have 

/(Lx*] 5 ,0 < /(x m ,z m ) < /(x*,z*). (11) 

Now we can estimate 

|/(x*,z*)-/(x"\z m )| < |/(x*,z*)-/(Lx*] 5 ,z*)| 

< L(C,D,M) ||x* - L x *l5|L 

< L(C,D,M)5 
= 6 -(Dd 1 A)- D 

<|/(x*,z*), (12) 

where the last estimate is given by (j5J) in the case that / is not constant on the 
feasible region. On the other hand, if / is constant, the estimate (|12jl holds trivially. 

By ITheorem 2.11 we can compute a point (x™ 2 ,z^ 2 ) 6Ffl x Z^ 2 ) such 

that 

(1 - f)/(x m ,z m ) < /(x^ 2 ,z^ 2 ) < /(x"\z m ) (13) 

in time polynomial in logm, the encoding length of / and P, the maximum total 
degree D, and 1/e. Here logm is bounded by a polynomial in logM, D and logC, 
so we can compute (x™ 2 ,z™ 2 ) in time polynomial in the input size, the maximum 



total degree D, and 1/e. Now we can estimate, using (|T3|) and (fT2|) . 

/(x*,z*) - /(x^ 2 ,z^ 2 ) < /(x*,z*) - (1 - f)/(x m ,z m ) 

= I /(x*, z*) + (1 - |)(/(x*, z*) - /(x m , z m )) 
<f/(x*,z*) + f/(x*,z*) 
= e/(x*,z*). 

Hence /(x- 2 ,z™ 2 ) > (1 - e)/(x*, z*). 

Part f6j. Let the dimension d > 2 be fixed. We prove that there does not exist 
a PTAS for the maximization of arbitrary polynomials over mixed-integer sets of 
polytopes. We use the NP-complete problem AN1 on page 249 of [H]. This is to 
decide whether, given three positive integers a, b, c, there exists a positive integer 
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x < c such that x 2 = a (mod b). This problem is equivalent to asking whether the 
maximum of the quartic polynomial function f(x,y) = — (x 2 — a — by) 2 over the 
lattice points of the rectangle 

„ f, , I- a (c-l) 2 -al 
P=Ux,y):l<x<c-l, —<y< y - ^ | 

is zero or not. If there existed a PTAS for the maximization of arbitrary polynomials 
over mixed-integer sets of polytopes, we could, for any fixed < e < 1, compute in 
polynomial time a solution (x e ,y e ) G PnZ 2 with \f(x e ,y e )—f(x*,y*)\ < e\f(x*,y*)\, 
where (x*,y*) denotes an optimal solution. Thus, we have f(x e ,y e ) = if and only 
if f(x*,y*) = 0; this means we could solve the problem AN1 in polynomial time. □ 
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A Appendix: An FPTAS for the integer case 



The first fully polynomial-time approximation scheme for the integer case appeared 
in our paper [5]. It is based on Alexander Barvinok's theory for encoding all the 
lattice points of a polyhedron in terms of short rational functions |2j. The set 
PnZ d is represented by a Laurent polynomial gp(z) = ^ctePnz d z "- F 10111 Barvi- 
nok's theory this exponentially-large sum of monomials gp(z) can be written as a 
polynomial-size sum of rational functions (assuming the dimension d is fixed) of the 
form: 

(14) 

where / is a polynomial-size indexing set, and where Ei € {1, —1} and Uj, Vjj € Z d 
for all i and j. There is a polynomial-time algorithm for computing this represen- 
tation [H 121 El El - 

By symbolically applying differential operators to the representation (|14fl . we 
can compute a short rational function representation of the Laurent polynomial 

g PJ (z) = /H 2 " ( 15 ) 

aePnz d 

In fixed dimension, the size of the expressions occuring in the symbolic calculation 
can be bounded polynomially: 

Lemma A.l (Lemma 3.1 of |6j). Let the dimension d be fixed. Let g p {z) = 
SaePnz d zC * ^ e ^ e Barvinok representation of the generating function of P n Z d . 
Let f £ Zi[x\, . . . , Xd] be a polynomial of maximum total degree D. We can compute, 
in time polynomial in D and the input size, a Barvinok representation g P j(z) for 
the generating function ^ctePnz d f( a ) zOC - 

Now we present the algorithm to obtain bounds that reach the optimum. 

We make use of the elementary fact that, for a set S = {s\, . . . , s r } of non-negative 
real numbers, 

k 



max{s 4 : Si £S}= lim {7£i=i s* (16) 
Algorithm A. 2 (Computation of bounds for the maximization problem). 

Lnput: A rational convex polytope P C R d , a polynomial objective / E Z[xi, . . . , xj] 
of maximum total degree D that is non-negative over PflZf 

Output: An increasing sequence of lower bounds L/-, and a decreasing sequence of 
upper bounds reaching the maximal function value /* of / over P n Z d . 

1. Compute a short rational function expression for the generating function 
gp(z) = Yla£Pnz dzOL - Using residue techniques, compute \P PI Z d \ = gp(l) 
from gp(z). 

2. Prom the rational function gp(z) compute the rational function representation 
of gpjk (z) of Yla£Pnz d f k {° L ) z,a ' i R bv lTheorem A. II Using residue techniques, 
compute 



Lk ■= \l g P jk(l)/g P>f o{l) and U k := Mg Ptfk (l). 
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Theorem A. 3 (FPTAS, Lemma 3.3 and Theorem 1.1 of |6j). Let the dimen- 
sion d be fixed. Let P C R d be a rational convex polytope. Let f be a polynomial 
with integer coefficients and maximum total degree D that is non-negative on PPiZi d . 

(i) \Theorem A. 31 computes the bounds L^, in time polynomial in k, the input 
size of P and f, and the total degree D. The bounds satisfy the following 



(ii) For k = (1 + 1/e) log(|P D Z d |) (a number bounded by a polynomial in the 
input size), L& is a (1 — e)- approximation to the optimal value f* and it can 
be computed in time polynomial in the input size, the total degree D, and 1/e. 
Similarly, Uk gives a (1 + e)- approximation to f*. 

(iii) With the same complexity, by iterated bisection of P, we can also find a feasible 
solution Xf £ P n Z d with 



inequality: 




/(x e )-/*| <e/*. 
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